Correction: Language Experience Predicts Eye Movements During Online Auditory Comprehension.

[This corrects the article DOI: 10.5334/joc.285.].

Language Experience Predicts Eye Movements During Online Auditory Comprehension.

Experience-based theories of language processing suggest that listeners use the properties of their previous linguistic input to constrain comprehension in real time (e.g. MacDonald & Christiansen, 2002; Smith & Levy, 2013; Stanovich & West, 1989; Mishra, Pandey, Singh, & Huettig, 2012). This project investigates the prediction that individual differences in experience will predict differences in sentence comprehension. Participants completed a visual world eye-tracking task following Altmann and Kamide (1999) which manipulates whether the verb licenses the anticipation of a specific referent in the scene (e.g. The boy will eat/move the cake). Within this paradigm, we ask (1) are there reliable individual differences in language-mediated eye movements during this task? If so, (2) do individual differences in language experience correlate with these differences, and (3) can this relationship be explained by other, more general cognitive abilities? Study 1 finds evidence that language experience predicts an overall facilitation in fixating the target, and Study 2 replicates this effect and finds that it remains when controlling for working memory, inhibitory control, phonological ability, and perceptual speed.

Integration of fundamental frequency and voice-onset-time to voicing categorization: Listeners with normal hearing and bimodal hearing configurations.

This study investigates the integration of word-initial fundamental frequency (F0) and voice-onset-time (VOT) in stop voicing categorization for adult listeners with normal hearing (NH) and unilateral cochlear implant (CI) recipients utilizing a bimodal hearing configuration [CI + contralateral hearing aid (HA)]. Categorization was assessed for ten adults with NH and ten adult bimodal listeners, using synthesized consonant stimuli interpolating between /ba/ and /pa/ exemplars with five-step VOT and F0 conditions. All participants demonstrated the expected categorization pattern by reporting /ba/ for shorter VOTs and /pa/ for longer VOTs, with NH listeners showing more use of VOT as a voicing cue than CI listeners in general. When VOT becomes ambiguous between voiced and voiceless stops, NH users make more use of F0 as a cue to voicing than CI listeners, and CI listeners showed greater utilization of initial F0 during voicing identification in their bimodal (CI + HA) condition than in the CI-alone condition. The results demonstrate the adjunctive benefit of acoustic hearing from the non-implanted ear for listening conditions involving spectrotemporally complex stimuli. This finding may lead to the development of a clinically feasible perceptual weighting task that could inform clinicians about bimodal efficacy and the risk-benefit profile associated with bilateral CI recommendation.

Video speeding can be efficient and speeding-induced preference cost can be lessened by selective speeding.

Over the past decade, screen-captured instructional videos have become popular tools for learning. Viewers wanting to learn efficiently can play these videos at faster-than-normal speeds, a feature offered by hosting services such as YouTube. Although previous research suggests that moderate speeding may not lessen learning, little research has tested this form of media for speeding-induced learning impairments. Further, even if learning is not impaired by speeding, the degree to which users find speed increases taxing and/or unpleasant is unknown. We therefore created a set of screen-captured instructional videos and tested whether speeding them by up to 250% affected learning, perceived workload, and preferences. Speed increases of up to 200% minimally affected learning, but even modest 150% speed increases substantially increased perceived workload and reduced viewer preferences. However, we were able to create videos that were more selectively speeded by concentrating speeding on pauses and relatively unimportant and slow speech. These videos were just as time efficient as the 150% speeded videos, but viewers preferred them. Our findings demonstrate that speeded instructional videos have the potential to facilitate efficient learning, and they suggest techniques such as selective speeding that may be used to support efficiency while lessening viewer preference costs. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

The contribution of form repetition to listeners' expectation of givenness in online reference resolution.

Although it is clear that unaccented referring expressions are associated with given information in a discourse (Dahan et al., 2002), it is less clear what aspects of givenness are relevant. We examine whether listeners' expectation of givenness depends on repetition of a referring expression or on contextual evocation of a referent. The results from two visual world eye-tracking experiments suggest that for interpretation, listeners associated reduced prominence with a repeated referring expression. Listeners expect previously evoked referents to be candidates for reduced referring expressions only when they are referred to with the exact same referential form. The data also suggest that when referents are referred to with different referential forms across utterances, accenting facilitates linking those forms for co-reference.

Evidence of Absence: Abstract Metrical Structure in Speech Planning.

Rhythmic structure in speech is characterized by sequences of stressed and unstressed syllables. A large body of literature suggests that speakers of English attempt to achieve rhythmic harmony by evenly distributing stressed syllables throughout prosodic phrases. The question remains as to how speakers plan metrical structure during speech production and whether it is planned independently of phonemes. To examine this, we designed a tongue twister task consisting of disyllabic word pairs with overlapping phonological segments and either matching or non-matching metrical structure. Results showed that speakers had more difficulty producing metrically regular word pairs, compared to irregular pairs; that is, word pairs with irregular meter had faster productions and fewer speech errors in this production task. This finding of metrical regularity inhibiting production is inconsistent with an abstract metrical structure that is planned independently of phonemes at the point of phonological encoding.

Word Recall is Affected by Surrounding Metrical Context.

It has been claimed that English has a metrical structure, or rhythm, in which stressed and unstressed syllables alternate. In previous research regular, alternating patterns have been shown to facilitate online language comprehension. Expanding these findings to downstream processing would lead to the prediction that metrical regularity enhances memory. Research from the memory literature, however, indicates that regular patterns are less salient and therefore less well remembered, and also that strings of similar sounds are harder to remember. This work suggests that, like lists of words with similar sounds, lists of words with similar metrical patterns are less accurately remembered than comparable metrically irregular patterns. The present study tests these conflicting predictions by examining the effects of metrical regularity in a recall task. We find that words are better recalled when they do not match their metrical context, suggesting that a regular metrical structure may not be beneficial in all contexts.

The scope of audience design in child-directed speech: Parents' tailoring of word lengths for adult versus child listeners.

When communicating with other people, adults reduce or lengthen words based on their predictability, frequency, and discourse status. But younger listeners have less experience than older listeners in processing speech variation across time. In 2 experiments, we tested whether English-speaking parents reduce word durations differently across utterances in child-directed speech (CDS) versus adult-directed speech (ADS). In a child-friendly game with an array of objects and destinations, adult participants (N = 48) read instructions to an experimenter (adult-directed) and then to their own 2- to 3-year-old children (child-directed). In Experiment 1, speakers produced sentences containing high-frequency target nouns, and in Experiment 2, they produced sentences containing low-frequency target nouns. In both CDS and ADS in both experiments, speakers reduced repeated mentions of target nouns across successive utterances. However, speakers reduced less in CDS than in ADS, and low-frequency nouns in CDS were overall longer than low-frequency nouns in ADS. Together, the results suggest that repetition reduction may be beyond speaker control, but that speakers still engage in audience design when producing words for relatively inexperienced listeners. We conclude that language production involves nested audience-driven and speaker-driven processes. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Masking auditory feedback does not eliminate repetition reduction.

Repetition reduces word duration. Explanations of this process have appealed to audience design, internal production mechanisms, and combinations thereof (e.g. Kahn & Arnold, 2015). Jacobs, Yiu, Watson, and Dell (2015) proposed the auditory feedback hypothesis, which states that speakers must hear a word, produced either by themselves or another speaker, in order for duration reduction on a subsequent production. We conducted a strong test of the auditory feedback hypothesis in two experiments, in which we used masked auditory feedback and whispering to prevent speakers from hearing themselves fully. Both experiments showed that despite limiting the sources of normal auditory feedback, repetition reduction was observed to equal extents in masked and unmasked conditions, suggesting that repetition reduction may be supported by multiple sources, such as somatosensory feedback and feedforward signals, depending on their availability.

Prosody indexes both competence and performance.

Prosody is an important feature of language that conveys a wide range of information. However, prosody is widely considered to be a difficult domain of study within the language sciences. One consequence of this is that existing grammatical theories of prosody fail to explain prosodic choices that seem to arise from nonlinguistic cognitive demands, such as communicative context, top-down expectations, and recent articulatory and acoustic experience. We provide an account of some of these phenomena and argue that linguistic theories that do not incorporate these factors into models of prosody are likely to mischaracterize its role in language. This article is categorized under: Linguistics > Language in Mind and Brain Psychology > Language Linguistics > Linguistic Theory.

Paying the meter: Effect of metrical similarity on word lengthening.

Language has a rhythmic structure, but little is known about the mechanisms that underlie how it is planned. Traditional models of language production assume that metrical and segmental planning occur independently and in parallel (Roelofs & Meyer Learning Memory and Cognition, 24(4), 922-939, 1998). We test this claim in two experiments. In Experiment 1, participants completed an event-description task in which a disyllabic target word shared segmental overlap with a prime that either had matching or nonmatching lexical stress. Participants lengthened words in trials with both segmental and metrical overlap, which could either be the result of metrical interference or having uttered a prime with similar segmental realizations. To adjudicate between these possibilities, Experiment 2 included segmentally distinct word pairs with either matching or nonmatching stress. Participants again showed lengthening in trials with both segmental and metrical overlap, but no lengthening from metrical overlap alone. These data suggest that the acoustic-phonetic similarity of the initial syllables of the prime and target creates competition that leads to word lengthening. These are consistent with production models in which segmental and metrical structures are tightly bound at the point of phonological encoding.

Self-Priming in Production: Evidence for a Hybrid Model of Syntactic Priming.

Syntactic priming in language production is the increased likelihood of using a recently encountered syntactic structure. In this paper, we examine two theories of why speakers can be primed: error-driven learning accounts (Bock, Dell, Chang, & Onishi, 2007; Chang, Dell, & Bock, 2006) and activation-based accounts (Pickering & Branigan, 1999; Reitter, Keller, & Moore, 2011). Both theories predict that speakers should be primed by the syntactic choices of others, but only activation-based accounts predict that speakers should be able to prime themselves. Here we test whether speakers can be primed by their own productions in three behavioral experiments and find evidence of structural persistence following both comprehension and speakers' own productions. We also find that comprehension-based priming effects are larger for rarer syntactic structures than for more common ones, which is most consistent with error-driven accounts. Because neither error-driven accounts nor activation-based accounts fully explain the data, we propose a hybrid model.

A failure to replicate rapid syntactic adaptation in comprehension.

Language comprehension requires successfully navigating linguistic variability. One hypothesis for how listeners manage variability is that they rapidly update their expectations of likely linguistic events in new contexts. This process, called adaptation, allows listeners to better predict the upcoming linguistic input. In previous work, Fine, Jaeger, Farmer, and Qian (PLoS ONE, 8, e77661, 2013) found evidence for syntactic adaptation. Subjects repeatedly encountered sentences in which a verb was temporarily ambiguous between main verb (MV) and reduced relative clause (RC) interpretations. They found that subjects who had higher levels of exposure to the unexpected RC interpretation of the sentences had an easier time reading the RC sentences but a more difficult time reading the MV sentences. They concluded that syntactic adaptation occurs rapidly in unexpected structures and also results in difficulty with processing the previously expected alternative structures. This article presents two experiments. Experiment 1 was designed as a follow-up to Fine et al.'s study and failed to find evidence of adaptation. A power analysis of Fine et al.'s raw data revealed that a similar study would need double the items and four times the subjects to reach 95% power. In Experiment 2 we designed a close replication of Fine et al.'s experiment using these sample size guidelines. No evidence of rapid syntactic adaptation was found in this experiment. The failure to find evidence of adaptation in both experiments calls into question the robustness of the effect.

Assessing priming for prosodic representations: Speaking rate, intonational phrase boundaries, and pitch accenting.

Recent work in the literature on prosody presents a puzzle: Some aspects of prosody can be primed in production (e.g., speech rate), but others cannot (e.g., intonational phrase boundaries, or IPBs). In three experiments we aimed to replicate these effects and identify the source of this dissociation. In Experiment 1 we investigated how speaking rate and the presence of an intonational boundary in a prime sentence presented auditorily affect the production of these aspects of prosody in a target sentence presented visually. Analyses of the targets revealed that participants' speaking rates, but not their production of boundaries, were affected by the priming manipulation. Experiment 2 verified whether speakers are more sensitive to IPBs when the boundaries provide disambiguating information, and in this different context replicated Experiment 1 in showing no IPB priming. Experiment 3 tested whether speakers are sensitive to another aspect of prosody-pitch accenting-in a similar paradigm. Again, we found no evidence that this manipulation affected pitch accenting in target sentences. These findings are consistent with earlier research and suggest that aspects of prosody that are paralinguistic (like speaking rate) may be more amenable to priming than are linguistic aspects of prosody (such as phrase boundaries and pitch accenting).

Individual differences in syntactic processing: Is there evidence for reader-text interactions?

There remains little consensus about whether there exist meaningful individual differences in syntactic processing and, if so, what explains them. We argue that this partially reflects the fact that few psycholinguistic studies of individual differences include multiple constructs, multiple measures per construct, or tests for reliable measures. Here, we replicated three major syntactic phenomena in the psycholinguistic literature: use of verb distributional statistics, difficulty of object-versus subject-extracted relative clauses, and resolution of relative clause attachment ambiguities. We examine whether any individual differences in these phenomena could be predicted by language experience or general cognitive abilities (phonological ability, verbal working memory capacity, inhibitory control, perceptual speed). We find correlations between individual differences and offline, but not online, syntactic phenomena. Condition effects on reading time were not consistent within individuals, limiting their ability to correlate with other measures. We suggest that this might explain controversy over individual differences in language processing.

Effects of Participant Engagement on Prosodic Prominence.

It is generally assumed that prosodic cues that provide linguistic information, like discourse status, are driven primarily by the information structure of the conversation. This article investigates whether speakers have the capacity to adjust subtle acoustic-phonetic properties of the prosodic signal when they find themselves in contexts in which accurate communication is important. Thus, we examine whether the communicative context, in addition to discourse structure, modulates prosodic choices when speakers produce acoustic prominence. We manipulated the discourse status of target words in the context of a highly communicative task (i.e., working with a partner to solve puzzles in the computer game Minecraft) and in the context of a less communicative task more typical of psycholinguistic experiments (i.e., picture description). Speakers in the more communicative task produced prosodic cues to discourse structure that were more discriminable than those in the less communicative task. In a second experiment, we found that the presence or absence of a conversational partner drove some, but not all, of these effects. Together, these results suggest that speakers can modulate the prosodic signal in response to the communicative and social context.

Evidence for the Influence of Syntax on Prosodic Parsing.

We investigate whether expectations based on syntactic position influence the processing of intonational boundaries. In a boundary detection task, we manipulated a) the strength of cues to the presence of a boundary and b) whether or not a location in the sentence was a plausible location for an intonational boundary to occur given the syntactic structure. Listeners consistently reported hearing more boundaries at syntactically licensed locations than at syntactically unlicensed locations, even when the acoustic evidence for an intonational boundary was controlled. This suggests that the processing of an intonational boundary is a product of both acoustic cues and listener expectations.

Reduction in Prosodic Prominence Predicts Speakers' Recall: Implications for Theories of Prosody.

Repeated words are often reduced in prosodic prominence, but the underlying mechanisms remain unclear. The present study contrasted two theories: does prosodic reduction reflect the choice of a particular linguistic form, or does ease of retrieval within the language production system lead to facilitated, less prominent productions? One test of facilitation-based theories is suggested by findings on human memory: Whether a second presentation of an item benefits later memory is predicted by the item's availability at the time of the second presentation. If prosodic reduction partially reflects facilitated retrieval, it should predict later memory. One naïve participant described to another participant routes on a map. Critical items were mentioned twice. Following the map task, the speaker attempted written recall of the mentioned items. As expected, acoustic intensity of the second mentions predicted later recall in the same way that difficulty of retrieval has in other tasks. This pattern suggests that one source of prosodic reduction is facilitation within the language production system.

Synthesizing meaning and processing approaches to prosody: performance matters.

Words vary in acoustic prominence; for example repeated words tend to be reduced, while focused elements tend to be acoustically prominent. We discuss two approaches to this phenomenon. On the message-based view, acoustic choices signal the speaker's meaning or pragmatics, or are guided by syntactic structure. On the facilitation-based view, reduced forms reflect facilitation of production processing mechanisms. We argue that message-based constraints correlate systematically with production facilitation. Moreover, we argue that discourse effects on acoustic reduction may be at least partially mediated by processing facilitation. Thus, research needs to simultaneously consider both competence (message) and performance (processing) constraints on prosody, specifically in terms of the psychological mechanisms underlying acoustic reduction. To facilitate this goal, we present preliminary processing models of message-based and facilitation-based approaches, and outline directions for future research.